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ABSTRACT 


The flexibility and ease of programming on an Analog Computer 
provide a theoretical-cum -experimental approach for the solution of most 
of dynamical problems and at the same time it provides a real insight 
into the behaviour of the system under study. A simple, fast and 
accurate method for solving linear and nonlinear programming problems 
using an Analog Computer is described in detail. The programming problem 
is interpretted as the asymptotic solution of a problem in the dynamics of 
a massless particle which is assumed to move in an n-dimensional space, 
§,way from those regions prohibited by the constraints of the problem and 
toward optimization of the objective function. The constraints or the 
objective function may not be linear but merely expressible with available 
Analog Computer components. A number of linear and nonlinear programming 
problems have been solved on three TR20 and the results compared with the 
solutions obtained using a digital computer. Post optimal analysis of 
these problems was also carried out. 
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CHAPTER I 


1.1 linear and Non-linear programming is concerned with finding optimal 
solutions to the static problems that arise in many fields of science 
and industry. The potential of an analog computer in solving such type 
of problems has often been overlooked partly because of the limited 
size of the problem that it can handle and partly because of limited 
accuracy. The size of the problem that can be solved on an Analog Computer 
is limited by the available number of computing amplifiers and the 
number of inputs to each amplifier. The latter difficulty is overcome 
by adding external equipment in the form of banks of coefficient 
potentiometers to the available Analog Computer TR-20. Regarding 
accuracy, however it must be borne in mind that a large number of 
industries employing optimization techniques are not able to provide 
problem data to the computer to an accuracy better than 1 i°. The analog 
computer method described obtain precision and accuracy well within the 
limitation imposed by the programming model itself. 

A Digital Computer solves a programming problem in a step by 
step numerical calculation at discrete points whereas an Analog Computer 
will solve such a problem in a dynamic fashion even though the problem itself 
is static. The advantage of solving a programming problem in a dynamic 
fashion is speed, since the solution point is calculated continuously 
rather than dis continuously point by point, and the resulting solution 
even for a large programming problem takes only a matter of seconds. 



2 


Moreover the operation of the Analog Computer provides a very- 
valuable insight into the nature of optimum seeking problem and its 
behaviour under varying parameters. 

1 .2 Outline of the thesis? 

Chapter II outlines the theoretical background for solving 
programming problems on Analog Computers . 

of 

Chapter III explains the method/solving IP (Linear Programming) 
problem on IE-2 0 and the Design of external equipment to allow more number 
of inputs to each amplifier for medium sized LP problems. 

Chapter IV illustrates a few LP problems and a transportation 

problem solution. along with their post-optimal analysis using TR-20 

✓ 

with additional inputs. 

Chapter V explains the extension of analog computer method to 
nonlinear programming problems and illustrates some examples. 

Chapter VI outlines other type of problems that can be solved 
using the same technique on Analog Computer. 

Chapter VII is the conclusion. 
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CHAPTER II 


THEORETICAL B/lCKGROUHIi 

2 .1 The general programming problem requires the evaluation of a number 
of unknowns so as to maximize or minimize an objective function subject to 
various constraints in the form of equalities and inequalities among 
functions of those unknowns. The programming problem may be expressed in 
the form* 

Kind x^ (i = 1 ,2 . . . . n ) to maximize 

Z(x) « c-j x-j +o 2 x 2 + c n x n (2 .1 ) 

subject to the constraints 


n 


Jri . 


Z a .ii *1 * t 


1.2 


m 


1=1 


& x^ ^ 0 i = 1 ,2 . 


n 


(2 . 2 ) 


If the coefficients c^, C 2 .... c n and a^, a 12 • • • • 

a & b . , b 0 . . . . * b are all constants, the resulting problem is 
mn 1 2 m B 

a linear programming problem. Z and A may be arbitrary, single valued 

d 

functions of x's. For the purpose of computation by the method to be 

described, the first derivative of Z(x) must be defined throughout the 

solution space and the first derivative of A. must be defined In the 

J 

neighbourhood of the solution space boundaries. Electronic Analog 
computers are built to handle relations between variables and their time 
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rate of change. It is therefore required, to prescribe the time rate 
of change of each variable appropriately. This time variation is in 
a fictitious analog time, for the problem being solved is a static one 
with no time dependence. 


2.2 Geometrical Interpretation* 

In geometrical language, the x^ are coordinates of particle Q 

cbc * 

in an n-dimensional space. The i are components of velocity vector 

dt 

» 

Qj of the particle. The method cf solution of programming problem on an 
analog computer is a variation of general method of steepest ascent 
(descent). The basic idea is to generate in the solution space a moving 
poinfc Q, that travels along the gradient of objective function to be 
maximized (minimized) until the optimum point is reached, thereby ensuring 
that the incremental changes in the solution displacement produce 
maximum change in the objective function. The velocity vector of the 
moving solution point can be defined by 
. m 

Q - sV z -iy £ y A (A ~ b ) (2.3) 

— J J J J 
0-1 


where 



jl 

0 if A.4lb. 
J— 0 


(2 4 ) 


Y Z denote the gradient of the objective function 


Z (x.,, 


. . . x ) and is defined as 


n 

h z 


& z 


grad Z a Y z “ (3 x 1 i^ + J- " - ig + . . . . 


6 Z . 

a** la 
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where . . . * i are the unit vectors of the eordinate 

system along x., , x-o • • • • x respectively. Similarly \*/ A. defined 

I Cm XA. 

a vector normal to the boundary hypersurface A. = b .. 

J J 

s is an arbitrary real number, which may be allowed to go to 
zero as the solution point is reached. 

K is an arbitrary large real number (may be 10 or lOO). 

In words the velocity of Q, is given as the velocity along the 

direction of the gradient of objective function minus the sum of 

velocities in the direction cf decrease of each A^ so long as constraint 

A is not satisfied. The signs of equation (2.3) are reversed if it is 
J 

desired to minimize the objective function. Hence so long as the point 

Q. (x^ , Xg .... x^) is inside the n dimensional space (i.e. all constraints 

satisfied) the velocity vector lies along the gradient wf the objective 

of 

function, thereby moving in the direction/steepest Ascent (Descent). As 

some of the constraints are violated at some finite distance beyond 

the boundary, the value of A. - b. will be such that the term 

0 J 

-kVa. (A.-b.) in equation (2.3) will just cancel the velocity component 

tj J J 

normal to the boundary- After that the velocity vector will lie parallel 

to the hypersurface for finite positive value of (A.-b-). At points 
* U J 

in the neighbourhood of relative maxima (minima) of Z, Q, will vanish. 

The value of constant s can then be made arbitrarily small, thereby 
reducing the quantity (A.-b.) and the point where Q, = 0 will he found 

<J J 

in or at the boundary of the solution space. 
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2. 3 The Analog: Set up { 

The essential elements of iinalog Computer needed to instrument 
the equations (2.3) and (2.4) are* 

( \ fly „ ' 

a) Integrators for obtaining x. by integration of i 

dt 

(b) Summers to compute the constraints 

(c) Decision elements to generate £>. and to ensure that x. 
are ^ 0 , The most convenient -way to perform this decision 
function is through the use of diode limiting circuits. 


The general procedure then is to write the time rate of change 
of variables x^ as 


x i 


= 8 


l 

3 *i 


m 


K 


I 

j=1 


lit 


1,2 • 


n 


where 


hi ^ ^ • 


m 


(2.5) 

(2.6) 


Equations (2.5) and (2.6) represent the general programming problem set 
up. For equations (2 . 1 ) and (2.2) we can write 


in 


B Pi - a oi e 3 1 ■ 1,2 

3=1 


n 

where e.. = £. ( JT a^ x ± - b.. ) j = 1 , 2 

i =1 


n 


m 


( 2 . 7 ) 


( 2 . 8 ) 


The resulting computer set up for equations (2.7) and (2.8) 
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is shown in Fig. 2.1. s is an arbitrary real number which may be allowed to 
go to zero as the solution is reached. Constant K is made large usually 
10 cr 100, in order that even a small error voltage of the order of few 
millivolts is fairly effective in keeping the solution point just near the 



Fig. 2.1* Computer Schematic for mathematical 
programming problem 


ihe variables x^ are integrated with respect to time from the 
starting point determined by the initial conditions x^(o), Xg^) . . . . 
x n (o), Ihe effect of error voltages Ke-j , Keg* * * * ^m ^ 0 

concel the component of each x^ that is normal to the boundary hyper- 
surface, thereby constraining the point 0, to move in the direction of 
increasing Z(x) but parallel to the boundary surface. At this stage 
the point Q will lie a very small distance outside the allowed region 
for any finite value of s. For a finite value of s the velocity vector 
will always have a component along grad Z until maximum (minimum) value 
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of Z is reached, The value of s can then be made zero to get the 

solution point. The diode connected across the integrator in Fig. 2.1 

ensures that the variables x^ are always ^ 0 and the diode connected 

across the inverter shown in Fig. 2.1 is used to keep the output cf 

inverter as zero so' long as A.-gCb.. When quantity A. is larger 

0 0 1 

than b., a voltage appears at the output of the hummer. This voltage is 
J 

multiplied by a gain constant K and fed back through an appropriate 
coefficient potentiometer to the integrator of the variable associated 
with that constraint. In addition to the elements shown, another summer 
is used to sum + c 2 x 2 + * * * * c n ®n “ Z ’ fclie ot 5 ec ' fcive 

function. 


2 .4 Analytic Explanation* 

The Analog Computer solution is based upon the property of an 
integrating amplifier that when the input voltage is made zero from a 
finite value, the output assumes a constant value. For maximization 


- 0 “ are fed to n integrators respectively so that when Z (x^,x 2 - . • rx^) 
1 c) Z 


is driven to its maximum value, 


C> x i 


have become zero, consequently the 


integrators input is zero and their outputs, now constant represent the 
value of x^ (i => 1 ,2 . . . n) which maximizes Z (x^ , x 2 - • • . x^). 

The introduction of constraints into the optimization process 

is achieved by the use of error voltages e. (0=1,2. . .m) such that 

*} 

e. is a large negative vcltage if jth constraint 
J 
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A. = a M + a. 0 + . . . a. x-^b. 

3 jl 1 J2 2 on n-- j 


is not satisfied, and 


is a ro if it is satisfied, The error voltage e , is applied tc the 

3 

appropriate integrator x^ in the negative sense to decrease the value of 
x ^ thereby readjusting the maximization process to satisfy the jth 
constraint, hi ode feed back around the constraint amplifier allow 


either e . rs 0 (jth constraint satisfied) or e. = large negative voltage 


(jth constraint not satisfied). 

The error voltage must be factored 

before feeding to the appropriate 

x^ integrator according to the 

effect the particular x^ has in 

generating the jth constraint i.e. 

for x., e. is factored by a... The 
i 3 3 1 


"hi 

a j1 Z 1 
a j2 X 2 


a - V 


a 

-/'■/•A -J- ; "p ,- . 1 

R ] - 

_///■ • 

R ; 

! 

' 1 


On 


Pig. 2. 2* Error voltages e. 

— k — 2 


6 


con >1 ition x. >’ 0 is ensured simply by „ 

i — 

diode feed back around x. integrator v 

l - a 22 JSe 2' “ 


as shown in Pig. 2.5 < 


R 

— - - V ’• 'A 

R 

Vv\ - 

1 


R 


; V- 


x i 


a .Ke ‘ 
mx in 


Pig. 2. 5? x^ integrator with 
constraint x^ $ 0 


2*5 discussion* 

It may not be possible to determine in advance whether 
a given programming problem has a solution or whether its solution is 
unique. Under these circumstances analog computer proves to be a 
handy exploratory tool. Any region of interest can be sufficiently 
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scanned by observing the solution with different sets of initial 
conditions thereby arriving at the desired solution. Scanning becomes 
necessary if solution point does not settle down to a point where all 
the constraints are satisfied, in case the solution point diverges 
toward infinity, the solution space is not alosed in the direction - of 
increasing values of the objective function, implying an improper 
programming problem. 

2 .5.1 LP Problems t 

The method described in 2.3 works very well for LP problems 
since there is only one maximum (minimum) in the solution space. The 
solution will be obtained on the first trial starting from any initial 
point within a matter of seconds. The time being proportional to the 
value of s. All the functions appearing in LP problems are sums of 
constants or constant multiples of variables. Therefore an DP problem 
always leads to a connected convex set which will have only one point 
within the solution space (defined by the constraints) at which the 
objective function has maximum (minimum) value. 

2.5.2 Nonlinear Programming Problems* 

Nonlinear programming problems present two major difficulties 

(a) Describing the nonlinearities mathematically and taking these 
nonlinear functions into account during the set up. This 
presents no problem on Analog Computer because a non-linear 
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function is treated in the same manner as a linear function. 
However expressing nonlinear function on Analog Computer does 
require more elaborate equipment. 

(b) Unlike LP problem, a nonlinear programming problem may have 
a number of local optimum points. This will warrant the 
scanning of the solution space by using different sets of 
initial conditions for each trial . Since a very large number 
of trials can be carried out in a relatively short time, this 
results in a good probability of finding the correct solution. 

2.5*3 Sensitivity Analysis i 

It is quite easy to change the coefficients in the objective 
function, the coefficients in the constraints or the constraints them- 
selves, merely by resetting the appropriate potentiometers. Therefore 
one can very conveniently explore the sensitivity of the problem as a 
function of parameters of the system and/or find the effect on the 
system of changes predicted in future. However the use of Analog 
Computer has the disadvantage that large problems require a large 
amount of Analog equipment and obtainable accuracy decreases with increase 
in size of the problem. 
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CHAPTER III 


5.1 A simple example will illustrate the Analcg method of solving 
LP problem* 

Ehcamnle 1 * 

Maximize Z = 3x^ + 5^ 2 (3 *1 ) 

subject to the constraints 


x 1 •: T 4 

X 2 6 

3x^ + 2 x 2 $ 18 

x f°5 x 2 ^ ° 


(3-2) 


Applying the method outlined in Chapter II the following time 
rates of change of two variables defined within the solution space are 
obtained* 

3*1 

5T~ " 

dx 2 

JT " 

Ihe solution space is bounded by five lines (see Pig. 3*1 ). If 
the solution point velocity vector Is defined as above, the point will 
move along the path shown in dashed line until the first boundary is 


c h 

‘d x i 


3s 


’( 9*2 


5s 


(3 *3) 


* Hillier, F.S. , G.J. Lieberman "Introduction to -operation Besearch" pp.139 
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CHAPTER III 


3*1 A simple example will illustrate the Analog method of solring 
LP problem* 


Example 1* 


Maximize Z = 3 x ^ + 5x 2 

subject to the constraints 

X 1 ' 4 

x 2 £4 6 

3x 1 + 2x 2 <; 18 

x 1 0 5 x g ^ 0 


(5.0 


(3-2) 


Applying the method outlined in Chapter II the following time 
rates of change of two variables defined within the solution space are 
obtained* 


^ X 1 c)z 

d t S 02C 1 

S x 2 c)z 

W " s a^ 


3s 


5s 


(3 .3) 


Ihe solution space is bounded by five lines (see Fig. 3 . 1 ). If 
the solution point velocity vector is defined as above, the point will 
move along the path shown in dashed line until the first boundary is 


* Hillier, F.S., G.J. Lieberman "Introduction to .operation Research" pp.139 
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reached. If the component of the velocity vector perpendicular to 
A^ is then removed by feed back circuits the point ■will continue tc 
move along A^ in the direction of increasing Z. UShen next constraint A^ 
is reached, the solution point will cease to move and if now the value oj 
s is allowed to approach zero the solution point will stop at the 
intersection of two constraints and A^, giving the solution as Z=36. 

3.1.1 Sealine:? 

It is obvious from equations (3*1) and ( 3 . 2 ) that scaling must 
be done first. In programming problems it is advisable to select scale 
factor for each variable to obtain the desired accuracy. 


Let p^ (i = 1,2 . . . n) be the scaling factor for each 
(i = 1 ,2 . . . . n) respectively . Then 


x i 

y. = and substituting it in equations (3-2) 

1 p i 


we get 


P 1 7 1 4 

P 2 j 2 - 6 

3P 1 y 1 + 2p 2 y 2 ~ 18 


(3 4) 


However it is obvious from equations (3*2) that x^ and x 2 can 
at the most be equal to 4 and 6 respectively, therefore their scaling 
factor p^ and p 2 should be 4 and 6 respectively. Allowing for some 
overshoot, devide each inequality of ( 3 - 4 ) by such a constant that makes 
each element of the HHS as less than cr equal to 1 . Therefore, dividing 
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equations srl. 1,2 and 5 °f (3*4) by 5» 10 and 20 respectively, 
we get 

P 1 

~~5~ y-j < 0.8 

p 2 

— y 2 .< o.6 ( 5 . 

3 Pl 2 p 2 

20 y 1 + ' 20 y 2 55 °* 9 

Now select the scale factors p 1 , p 2 and such that all the 
constant elements of the constraints are less than or equal to 1. 

Selecting P 1 =5 p g ** 8 
and writing (5.5) in the table (3.1) 


' Constraint , 

No. j 

i 

“Variables A | 

, V Snecification ! 

r 5 v 5 1 

) 71 8 } | 

1 

1 -i 0.8 | 

2 

0.8 0.6 ! 

{ 

i 3 

j 

V 

0.75 0.8 xT 0.9 i 

i 

Table 3 - 1 * 

Scaled coefficients of example 1 


Now writing the objective function in terms cf y 
z *=* 15 y-[ + 40 J2 

z - ~q = 0.3y 1 + 0.8 y 2 (3.6) 





16 


3.1 .2 -Analog Solution ? 

The analog computer circuit necessary to instrument table 
(3.1) and equation (3*6) is shorn in Fig. (3.2) . 

The error voltages are set up from table 3*1 and are shown in 
Fig. 3. 2(b). Generation of y^ and ds indicated in Fig. 3. 2 (a). Pot . 
(Potentiometer) settings of the scaled problem are indicated in the 
Fig. 3*2 itself. Setting of pot s is initially unity. Germanium diodes 
were used. In the event of "constraint being satisfied”, the error voltag 
were found to be small positive values of the order of. 0.1 volts or so 
instead of being zero. Therefore intermediate diodes D4, D5 and 336 were 
added tc achieve zero error voltage. The following procedure results 
in better accuracy than obtainable otherwise. 

3-1.3 Operating procedure? 

1 . Batch up the various tested components of TE-20 as per the 
scaled diagram of the problem , 

2. Set the various pots to the desired value, keeping the setting 
of pot s to unity. Pot setting of the external coefficient pots is done 
as per 3*4 and switch the computer from ’Reset r to ’operate*. 

3. Allow 2-3 seconds to enable the outputs of various integrator/ 
amplifiers to attain steady state value . 

4 * Check the values of constraint amplifiers 3»7 and 8. For '+Ve 
error voltages make the corresponding factor K as 1 instead of 10. For 
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-ve error voltages short circuit the corresponding intermediate diode 
and keep K=1 0. 

5* Reduce the setting of the pot s from unity to zero. Repeat steps 

3 « 4 if found necessary. 

The results obtained for example 1 are 

x.j = .401 x 5 = 2.OO5 error = x 100 = .25 i° 

x 2 = *749 x 8 = 5*992 error = " x 100 = .13 ?jo 

z = .72x50 = 56 


The above procedure ensures that all the constraints are being full 
satisfied and the results obtained are fairly accurate. 


3 *2 Additional aids to computation* 

1. For minimizing instead of maximizing an objective function , apply 

OZ' O Z r 

instead of - to the y. integrator. 

o^i c) y"i 

2. To interchange the restricted and allowed region for any constraint 
edge, reverse the diode connected across the corresponding constraint amplifis 

3. Negative coefficients among the constraints must be treated by the 
introduction of an inverter in the corresponding path since each such 
coefficient enters the wiring diagram twice. Two inverters are required 
for each negative term. 


4.. Negative coefficients in the objective function are handled by the 

R') 2 ' c) Z 1 

application of ■ — instead of at the appropriate integrator input. 

a 7 1 O 7 ± 


5. To incorporate equality constraint instead of inequality constraint, 


remove the diode connected around the appropriate constraint amplifier. 
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6. If the integrating capacitors are all started from a discharged 
condition, the solution point will start its motion from the origin. For 
scanning purposes it may be desired to start the solution point from another 
initial condition. This is achieved by introducing appropriate initial 
voltages on the integrating capcitors . 

3 *3 limita tio ns of Analog Computer* 

The main limitations in the use of Analog Cmputer for programming 
problems are i 

1 . Size of the problem is restricted by the available number of amplifier 
and potentiometers and the number of inputs to each amplifier. 

2. Hie accuracy decreases with the increase in size of the problem. 

The number of amplifiers required for any IF problem are 
= n + 2m + p+2 out of which n are integrators 
where n = Number of variables in the problem 

m = Number of constraints in the problem 

p = Number of rows plus columns containing ‘negative coefficients 
in the LHS of constraints . 

One amplifier is required to generate the objective function and another 

> JZ 

is required in generating -‘-r — . 

Number of potentiometers required for solving IF problem are 
2g + 2h + m + 1 

where g = Total non zero coefficients on the 105 of the scaled 
constraints . 

h = Number of non zero coefficients in the scaled objective 
function. 
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m = Number of scaled non zero RHS elements in the constraints. 
Number of diodes required for solving DP problem are = n+2 x m 
where n = Number of variables in the problem. 

m = Number of inequality constraints in the problem. 


bse of three TR-20 Analog computers provide 60 amplifiers (24 
integrators) and 72 potentiometers. However, the main limitation comes from 
the limited number of inputs available to each amplifier. Since there are 
only two inputs of gain 1 and two inputs of gain 10 to each amplifier. It 
is obvious from the discussion so far that each constraint amplifier requires 
as many inputs of gain unity as there are number of coefficients in that 
constraint including RHS elements, which, for example may be 10 for a nine 
variable problem. Also each integrator requires as many inputs of gain 10 
as number of coefficients in each column of set of constraints excluding 
RHS vector. It therefore warrants the design of an external equipnent in the 
form of variable banks of extra inputs of gain 1 and gain 10 along with additic 
potentiometers to supplement the potential of the three TR 20 Analog Computers. 


3 .4 Design, of External Equipment for additional inputs to TR-20 ? 

Ihe inputs resistors used in TR -20 are fixed Resistor, wire wound, 

precision type, + .05$ and of the values shown in Pig. 3 * 3 * The resistor 

,\\A. 1 00K 

selected for the external equipment 100K 


are 10K and 100K, + 1%, iw, metal film 
resistors which are highly stable. 

Only the resistors within + .25% variation 
were selected for the purpose, To ease out 


E 1 

£ 

E 

■7 

e" 


-/vWi 

1 0K 

-'■Ws— 

JOK 


r- 

w 


B 


~4 


Iig* 3 - 5 : Input Resisters with 
each amplifier 



20 


the problem of additional pots, a 3*3^ potentiometer was connected in 
series with each 10K/100K input resistor for various coefficient settings. 
The potentiometers used are single turn, 3*3^, metal film type which give 
fairly stable settings. The set up for this equipment is shown in Pig. 3*4* 
The shaded circles represent the sockets for external connections. Suppose 
it is desired to add three additional inputs to any amplifier, the following 
procedure should be adopted in order to take into account the effect of 
loading and for accurate setting of external pots . 


1. Interconnect the "To SJ" terminals of three rows (say A^ , and A^) 
by jumper wares as shown in Pig. 3 *4* 

2. Connect one of these "To SJ" terminals to the accessible SJ terminal 
of the amplifier whose number of inputs are required to be supplemented. 

3. Peed -10 V at input terminal of and set the corresponding pot 
to the desired value by null method so that the output of the amplifier in 
question is same as desired pot setting. Remove -10V from input terminal of A, 

4. Repeat step 3 for Ag and 

5. Connect the desired inputs to input terminals of A^ , and A^. 


Two external boards of the type showaa in Pig. 3*4 were constructed 
and fitted on top of two TR-20, thereby giving a total of JO additional inputs 
of gain 1 and JO additional inputs of gain 10. In addition 60 additional pots 
were also incorporated giving total number of available potentiometers for 
programming as 72 + 60 = I32. It is felt that this external equipment has 
greatly enhanced the capability of existing TR-20 Analog Computer in solving 
Linear and nonlinear programming problems. 








HB aMBBllllBii 

mm 
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CHAPTER IV 

LP EXAMPLES WITH THEIR POST-OPTIMAL ANALYSIS 

4 .1 Introduction t 

Once an IP problem of practical interest has been solved, 
situations may arise whiuh require additional computation. 

With practical problems we are often interested in not only the 
optimal solution of the given problem but also desire to know the effect of 
parameter changes on the solution, such as the profits (c^ ) or the elements 
of requirement vector (b . ) or the elements of constraint vector (a..). In 
certain cases, after solving the problem, it may be discovered that one car 

more of the profits were incorrect, one or more of b. were wrong or perhaps 

D 

a decimal point was misplaced in some of the a. . etc. etc. In Analog computer 

*^■0 

method the above problem can be overcome simply by solving the problem with 
revised pot settings, We will now consider in detail some typical LP 
problems bringing out the scaling procedure and post-optimal analysis as 
explained above. 

4.2 Example 1 s 

This example is the modified version of a LP problem* involving 
6 variables and 8 constraints. This modification was done to fully utilize 
the two TR- 20 ’s and the external boards for additional inputs. The example 
given below involves 8 variables in 12 constraints. 

Maximize Z = 8x^ + 6x 2 * IQx^ + Sx^ + 5 ^ + 4 xg + 8X7 + 6xg (4.1 ) 

*Hillier, F.S., G.S. Lieberman, "Introduction to Operation Research, pp.551 
Ex. 
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Subject to* 


X 2 + x 3 + 

x 4 + x 5 + x 8 

2 . 5 ^ + 2x 2 + x^ +X* 6"Xg. 

x 1 + 3x 2 • 

f x 5 + 

2x.| + x 2 ' 

*■ 4x 5 + x g 

x 5 + x 4 + 

x 6 

2x^ + 2x,- 

+ 3x 6 

x^ + x^ + 

x 4 

x 4 + x 5 + 

x 6 

3xg + 5x^ 

+ 4x 8 

3x 2 + 4x^ 

+ Xg 

4x^ + 3x^ 

+ x ? 

5x 1 + x^ 






25 

35 

15 

15 

15 

20 

10 

5 

15 

10 

20 


35 


(4*2) 


and x^ 0 for i = 1 ,2 . . . . 8 

4»2.1 Scaling s Because of the uniformity in the magnitude of the elements 

of various vectors, the scaling in simplified considerably. Dividing constrain 

( 4 . 2 ) by 10 and normalizing all variables to one maximum value x^ = 5 such that 
* 

y. *= 1 for i = 1 , 2 ... 8 . Hie scaled problem constraints are tabulated 

5 

in table 4*1 • 


Writing objective function Z in terms of y^ and dividing it by 200, we get 

200 3 z * = •2y 1 + .15y 2 + * 25 y 3 + . 2 y^ + .I25y 5 + .1y g + .2y ? + .igy 8 

(4.3) 
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Table 4 * 1 5 Coefficients of the scaled constraints 
for example 2 


4-2*2 Analog Solutions 

The analog computer diagram with the pot. settings is shown in , 
Appendix ’A 1 . For this problem two TR-20's and 55 external inputs were 
utilized. The problem utilized the following analog computer components 
(refer to 5 . 5 ). 

(a) Amplifiers = 8 + 2x12 + 2 = 54 (8 integrators) 







25 


(b) Potentiometers = 2x40 -KhcS + 12+1 = 109 

(c) Diodes = 8 + 2x12 = 52 

Using the procedure outlined in 5*1 *3 » 'the solution obtained is 
tabulated in table 4*2. Ihe same problem was also solved on IBM 7 O 44 
using DP package, the results of which are also tabulated in table 4*2 
for comparison sake. 


i Variables 

1 

? 

| Scaled 

U s oluti on 

I Analog 

q solution 


■ 

Error 

j X 1 

CM 

CO 

• 

4.12 

4.1704 


1.2# 

* 

i! -^*2 

. .405 

2.025 

2.0000 


1 .25# 

i 

! 3 

.978 

4*89 

4*8295 


1.24# 

X 4 

.205 

I.015 

1.0000 


1.5# 

I 

i 

i 

.047 

.255 

0.2272 


3*42# 

i x 6 

0 

0 

0 


- 

1 

L 7 

0 

0 

0 


- 

!i 

|! X 8 

.76 

3.8 

3.75OO 


1*33# 

j| z 

.65 

126 

125.295 


O.56# 


Table 4»2* Comparison of .Analog and Digital solutions 
for example 2 


Error column in Table 4*2 represents the deviation of analog solution 

from digital solution expressed as percentage of the digital solution. 

It is seen that the error in x r is more pronounced than the other variables. 

5 

This is attributed to the small magnitude of scaled solution. The accuracy 
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can be improved by using a smaller scaling factor for x^. 

4.2.3 Post optimal Analysis t 

The effect of variation of SHS elements (Bosources available) 

on the objective function was studied at discrete points. One element 

of the EHS vector (b.) was varied at a time with the help of caliberated 

potentiometer and the corresponding value of the objective function 

recorded. The values of the variables (x^ , X2 • • • Xq ) were observed 

simultaneously and any changes from the basic feasible solution recorded. 

Table 4*3 gives the effect of variation of b. on objective function. The 

J 

corresponding curves are plotted in Pig.4.1 (a) and (b). Consider the 

variation of bj and its effect on objective function from table 4.3 and 

Fig. 4.1 (a). For b^ *= 15, Z « 126 i.e. optimum solution. This is 

represented by point A in Fig. 4.1(a). As b^ is decreased from 15 , Z also 

decreases and when Z = 112 , variable Xg which was previously in the 

solution basis becomes zero* and remains so subsequently. This is indicate 

in the remarks ciumn of table 4*3* A further decrease in b^ reduces the vali 

of objective function and other variables in the basis. If however after 

obtaining the optimum solution with given constraints, b^ is increased 

from 15, Z also increases thereby indicating the room for further 

improvement in the objective function. It can be seen that Z can be 

improved only by increasing b^ , b^, b^, b^Q or This was confirmed 

from the subroutine "BHS ranges" of the LP package. This subroutine gives 

only the upper and lower limit for each b. so that the solution basis 

J 

do not change. It is clear that the post optimal analysis on Analog 








marks h b 
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Table 4*5* Record of the effect of variation of b, on objective function. (z) 
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computer provides very valuable information easily whereas extensive 
digital computer programming will be required to achieve the same results. 

4.5 Rgamule 5 ? 

This problem is the simplified version of an LP problem from a 
thesis work*. The size of the problem was cut down because the available 
number of analog computer components were not sufficient in number to solve 
it. This example involves 9 variables in 14 constraints. Unlike the last 
example where all the variables were scaled by the same factor, different 
sealing factors are chosen for different variables to- giv® better accuracy. 
Maximize 

Z « 9.5 x 1 + 12 x 2 + 5*5 *3+15*4 + 2x 5 +5x 6 + ^7 +1Q V 5 ‘ 5x 9 (44) 

Subject to 5 

Multiplying factor ! 


1/3 | 

X-j + 

x 2 +x 5 

s 

2.75 

1 | 

X + 

x 4 

x 5 +x 6 


.85 

1 I 

i 

X 2 + 

x 4 

— 

•75 

1/3 i 

x 1 + 

X3 +x 5 


2.2 

1 

X? + 

X 8 


»75 

1/2 ; 

x 9 


.y 

1-5 

1/3 | 


+ .7x 4 +.?x 6 


2.3 

1/2 

• 4 *^ 

+ .25xg+6.5x Q 


1 .25 


* Maj. A.V. Rao, "Algorithms for LP solutions for varying model 
Parameters", Thesis E.E., IIT-Kanpur . 
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Multiplying factor 
l/2 
l/lO 
1/10 
l/lO 

1/5 

l/2 


.25Xy+2 .2 Xq+.1x<j -c. 1.2 

. 8 x^ + 2 x ^+2 . 5 xq .4 8 .5 

.5x^+.5xj+.5x^+-5x^ 8.5 

1 .2x 1 +1 -5x^+1 -5x^ +1 . 7 x 6 8 .5 

1.3 x 1 +.15 x 4 +.15 x 6 +.9 x ? +.3 x 9 s 2.5 

.2x2 + 6xg ^ 2 

& x i -? 0 for i = 1,2 , . . 9 


( 4 . 5 ) 


4 . 3 .I Scaling { We write y. = — — and multiply each constraint 

1 P i 

in ( 4 * 5 ) hy such a constant so that each element in the EHS vector is 
less than or equal to unity. The values of the constants are indicated 
in the "multiplying factor" column shown in ( 4 . 5 ). Prom set of constraints 
(4.6) t select constants p.^ (i ® 1 ,2 ... 9 ) corresponding to each y^ (i=1 ,2 . . . 9 ) 
in such a way that all the IBS constraint elements of ( 4 * 6 ) are less than 
or equal to unity. 


It can be visualized that non uniform scaling of the variables 
becomes quite involved, since all the constraints have to be checked for 
each p^ - It is therefore felt that, initially, all the variables should 
be scaled by the same constant and solution obtained on the analog computer. 
Hie solution itself shall warrant the rescaling of some of the variables 
which can be accomplished easily. 
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£l ^2 

7*1 + yg j — y^ 

< .9167 

p 4 y 4 + p 5 y 5 + p 6 y 6 

.85 

p 2 y 2 + p 4 *4 

*75 

P 1 *5 p 4 

T y 1 + T y 5 + 3 y 5 

cr' *733 

P 7 y ? + P 8 y 8 

.75 


2 y 9 


*75 

4 !i v + '! h . - 21 & 

3 y 3 + 3 y 4 + T~ y 6 

<C 

*767 

• 4 P 1 . 25 p 6 6 . 5 p 6 

2 y n + 2 y 6 + 2 y 8 

<C 

.625 

• 25 P 7 2«2p 8 .Ip 

2 y 7 + 2 y 8 + 2 y 9 

s % 

.6 

2 h , 2p 7 2-5p 8 

10 y 1 10 ^7 4 10 y 8 


.85 

* 3 P-j * 5 P^ * 5 P 7 * 5 Pq 

10 y 1 1 10 ^3 1 10 y 7 f 10 y 9 

<r^ 

.85 

1 . 2 Pl 1 - 5 p 5 i. 5 p 4 1 * 7 P 6 

10 y i 1 10 " v 3 1 16 • y 4 1 10 y 6 

4 T 

*85 

1 - 5 P 1 . 15 P 4 * 15 P 6 * 9 p 7 * 3 Po 

5 * 5 ^ { *7 * ^ 7 ^ 


•5 

^Pg 

“2^2 + ~ y 8 


1 

Selecting « 3 



% - p 4 - p 5 - p 6 - ^ - 1 




P 8 - l/4 P 9 » 2 


(4.6) 


» 1 


(4*7 
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Hie scaled constraints are written in Table 4.4* 


Constraint ' 

; Variables I 

j 

Ho. ( 

y 1 

y 2 y 3 

y 4 y 5 

y 6 

y 7 

y 8 

79 

J Specification 

1 

1 

.333 1 






^ .9-167 

2 



1 1 

1 




< .85 

3 


1 

1 





.75 

4 

1 

1 

.333 





*735 

5 





1 



^ -75 

6 







1 

.75 

7 


•4 

.253 

• Z 35 




< .767 

8 




.125 


.8125 


<r .625 

9 





.125 

.275 

.1 

.6 

\ 

1 10 

*24 




.2 

.0625 


j ^ * Q 5 

1 11 

1 

1 

.09 

.15 



.05 


.1 

J 

< .85 

> 

t 

1 

12 

•36 

.45 

.15 

.1? 




i 

. ^ *85 

13 

•78 


.03 

.03 

.16 


.12 

1 ~ *5 

14 

i 

f 

1 

.3 




.75 


i< 1 

1 

i 

i 


Table 4.4* Coefficients of the scaled constraints for example 3 . 

The objective function Z is written in terms of y^ and 
dividing it by 5^* 


5 §- “ z'» *57y 1 + '.24y 2 + .33y 5 + *3y 4 + .°4y 5 + *ly 6 + *i6y ? + 

•°5y e + »i4y 9 


(4*8) 
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4*3*2 Analog Solution i Big Analog Computer set up diagram alongwith 
with pot. Settings for table 4*4 ari 4 equation 4*8 is shown in appendix 'B* 
^he problem utilized the following components (para 5*3 refers) 

(a) iimplifiers = 9 + 2x14+2 = 59 

(b) Pots = 2x4 0+2x9+14+1= 113 

(c) Diodes = 9+2x14 = 37 

Using the procedure outlined in 3 • 1'3 » an Analog computer 
solution was obtained and is tabulated in table 4*5* The same problem was 
solved on IBM 7O44 using LB package, the results of which are also tabulated 
in table 4*5 f°r comparison sake. The maximum error is about 3$ in Xg. 
Percentage error column represents the deviation of digital solution 
expressed as percentage of the digital solution. 



Table 4*5* Comparison of Analog and Digital solution for example 3* 
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4 * 3*3 Post-optimal Analysis > In example 2, the effect of 
variation of BHS elements on objective function was studied. Here 
the effect of variation of the profit vector on the objective function 
will be studied at discrete points for this problem. One element of 
C jL of profit vector was varied at a time with the help of calibrated 
potentiometer and the corresponding values of the objective function 
recorded in table 4 * 6 . The values of the variables (x^ , . . were 
observed simultaneously and changes from the basic feasible solution 
recorded in the remarks column of table 4*6. The corresponding curves 
are plotted in fig. 4. 2 (a) & (b). 

Consider the effect of variation of c,~ on objective function 
from table 4.6 and fig. 4.2. For c^ = 2, Z = 4O.5 Ii> the optimum solution. 
This is represented by point A in fig .4 . 2 (a), hs is decreased from 2 
to zero, Z is not affected. As c^ is increased from 2 to 5, still Z 
remains 46.5* This is qui to _ obvious since x^ = 0 in the above range. 
However at enters the solution basis thereby resulting in 

increase in the value of the objective function. 

Careful sti dy of fig. 4. 2 will give a valuable insight in the 
behaviour of the variation of objective function, as profit elements 
(c^) are changed and one can select most profitable stregegy if some 
of the c^ are to be varied. For example decrease in the value of from 
15 to zero results in reducing the value of the objective function 
merely from 4^*5 to 39 * 6 . 








39.2 0 35*35 0 39*43 



objective function (z) 
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!*4 Px j mple 4* This is a "blending problem, the type of which occurs 

quite often in the petroleum industry, A refinery produces three grades 

of Aviation gasoline and automobile gasoline by blending four components 

(refinery streams) which are available in limited amount per day. There 

avivfcen 

are two quality specifications for each /product. 

(a) -tin upper limit on the admissible vapour pressure. 

(b) A lower limit on the octane rating. 


These two characteristics, which are measures of the volatality 
and the ignition properties of gasoline respectively, can be assumed to 
blend linearly, x. . represent the amount of product j in barrels per day 
produced from the constituent i. The problem is to determine the optimal 
values of 16 unknovms x. . subject to 10 restrictions, that can be derived 

lj 

from the data, namely, four material balances for the respective ingradients 
and two quality balances for each of three grades of aviation gasoline. 

Thus the objective function is to maximize. 


Z = 5Cx 11 + x 21 -<x 5l +x 4l ) +5-5 (x 12 + x 22 + x 52 + x 42 ) 

+ 6 (x 13 + x 2? + x 33 + x 43 ) + 4-5 Gt 14 + * 24 + * 34 + x 44 ) 


(4.9) 


*Sven Dano, "Linear Programming in Industry", pp. 45-46. 
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Subject to the following constraints: 


X 11 

+ X 

12 +x 13 

+ x 1 4 



= 

3800 



X 21 

+ X 

22 + x 23 

+ x 24 



= 

265O 



X 31 

+ x 

32 + x 33 

+ x 54 



= 

4 080 



X 4 1 

+ X 

42 + x 43 

+ x 44 



= 

1300 



I4x 

11 4 

5 x 21 - ( 

0X3^ + 

15^41 


-> 0 




- 1.0x 21 

+ 5 -^ 

31 

- 

13 

•*41 


0 

16 .; 

5x 12 

+ 2 x 22 

’ 4x 32 

+ 

173 

: 42 



0 

2*0 

c 12 

- 1 "O&22 

+ 5 .ox 

32 

- 

13 

• 5 i 42 


0 

7.^,5 

- 7 x 2 j - 

23 x 55 

+ 1 

Bx 

43 


> 

0 

2 *Q>c 13 

~ 1 *0^25 

+ J.Qk 

33 

- 

13 

;S 43 

V. 

0 

x ii 

>0 

for i = 

1 ,2.-4 

& 


£= 

1 ,2. , 

4 



( 4 - 10) 


Hie EHS elements of first four constraints of (4.10) represent 
the amount oflbur constituents available in number of barrels per day. 

4.4 *1 Scaling ; Dividing constraints Sri. 5 to 10 of (4.10) by 25 and 
writtag y y - ^for t - 1,2, 5, 4 

& j = 1,2, 3, 4 

The scaled constraints are tabulated in table 4*7* 


YFriting the objective function Z in terms of y. . and scaling. 


we get 


Z 


5000x20 


= 7 ,' 


z' = •25(y 11 ^ 12 ' 4 y 1 ^ 4 y 14 ) + *275(y2i 4 y22' ty 23' ty 24^ 

+ - 5 (y 3^32^33^34) + * 22 5 (y 4l ^42^45^44 } 


(4-11) 
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4*4-2 Analog Solution* The Analog Computer set up diagram for table 

4-7 and equations (4.1 1 ) along with the pot. settings is shown in Appendix'C 1 . 

The problem utilizes the following components (Refer to para 3-3). 

(a) Amplifiers = 16+2x10+2 =38 

(b) Pots = 2x24+2x16+4+1 = 85 

(c) Diodes =12+16 =28 

Using the procedure outlined in 3*13 the solution tabulated in table 
4.8 was obtained. The same problem was solved on IBM 7044 using DP package, 
the results of which are also tabulated in table 4-8* for comparison sake. 

It is seen that a /° error in x^^ and x^ is considerable. 


HH 

Scaled 

Analog 

solution 


Digital 

solution. 

| Percentage 
fi error 

A ... . 

x n 

0 

0 

0 


X 12 

0 

0 

0 

- 

x 13 

0 

0 

0 

- 

X . , 

0 

0 

0 


14 





X 21 

.OO5 

25 

34-57 

27.7 

X^ 

0 

0 

0 

— 

22 





x 23 

*591 

2955 

2958-73 

.127 

X 24 

.134 

670 

662.62 

1 .12 


• 756 

3780 

3765-43 

*39 

x 32 

*536 

2680 

2650 

1.15 

x 33 

,221 

1105 

1121.26 

1.45 

b4 

.128 

64O 

6IO.714 

4.8 

Hi,. 

0 

0 

0 


41 





X . ^ 

0 

0 

0 

— 

42 





X - -V 

0 

0 

0 

— 

43 





x 44 

.0045 

22 

26.67 

17.5 

Z 

.693 

69300 

69112 

.272 


Table S4.8* Comparison of Analog & Digital solution for example 4 
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The optimal values of x^ & x^ are 54*57 & 26.67 respectively 
and the scaling factor of 5OOO used in scaling these variables is too 
large comparatively. This has resulted in very small scaled values of 
these variables and small error of the order of .001 in the scaled solution 
of these variables Trill reflect a larger percentage error. It is obvious 
that if the scaling factor for Xg-j & x^ could be made 100, the accuracy 
in the results of these variables will improve. However, the study of 
table 4*7 indicate that the scale factor for Xg-j & x ^ can at the most be 
reduced to 1000 and 25 OO respectively, without affecting the accuracy of 
other variables adversely. Therefore the accuracy for these variables could 
not be achieved better than 1 Cffo or so. 

4*5 Example 5* (Transportation problem) • One of the commonest application 
of Linear Programming is the transportation problem. Here it is required 
to arrange the flow of goods from say, a number of warehouses to the firm 
customers. The system cnstraints arise from the customer demand and 
availability of goods at each warehouse. The function to be minimized is 
the total transportation cost. A problem with three origions and seven 
destinations was studied using three TR-20 Analog Computers. Table 4*9 
gives the transportation cost matrix (Rupees/Ton), the availability at 
three origins (Tons/day) and the demands (Tons/day) at seven destinations. 
The demand at each destination must be met. 


*Hadley, G. , "Linear Programming" pp.524, Prob.9*17* 
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Origins 




Destinations 

- . . . 

J Total availability 

Pi 

D 2 

D 3 

D 

A 

Fa 


D 7 

y i. Uxib / Udj 

.. 

°1 

10 

8 

16 

3 

10 

25 

! 

18 

; 

10000 

°2 

19 

25 

18 

7 

12 

18 

19 

5000 

' °n 

j 

20 

i 

17 

20 

' 

5 

14 

j 

16 

t 

17 

i 

10000 

Total dem- 
and 

Tons/Day 

! 

i 

2000 

1000 

3000 

4500 

Ul 

0 

0 

600 

i 

j 

950 



Table 4*9* Transportation cost matrix (Rupees/Ton), 

Availability (lons/day) and demands (Tons/Day). 


This problem can be expressed as the following linear programming 


problem. 

Minimize Z = IQx^ + 8x^ + I6x.^ + 3x^ + lOx^ + 25 + 18x^ 
+ 19x2-] 25 x 22 "*® x: 23 ?*24 ^ 2 X 2 ^ ^^"27 

+ 2Qx 51 + 17 x 5 2 + 20x 33 + 5x 54 + 1 4 x 55 + l6x j6 + 


Subject to the constraints 

Z 11 + X 12 + x 13 + x 14 + X 15 +X 16 +x 17 

X 21 + x 22 + x 23 + x 2 4 + X 2 5 + X 26 + X 27 

x 3i + x 32 + x 33 + x 34 + x 35 + x 36 + x 37 

X 11 + x 21 +X 31 

x 12 + X 22 + X 32 

x 13 + x 23 + x 33 


^ 1 occo 

<- 5 000 
^ 1 0000 
= 2000 
= 1000 
= 3000 


(4*12) 
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X 14 + x 2 4 + x 34 
x 15 + x 2 5 + x 35 
X 16 +x 26 +x 36 


& x. . 45^ 0 for i 


x 17 + x 27 + x 37 

- 1,2,3 & j = 1,2,.... . 7 ■ 


= 45OO 
= 500 

= 600 
= 950 


(4.13) 


4-5*4 Scaling This problem has 21 ( 3 x 7 ) variables and 10 ( 3 + 7 ) 
constraints. It is clear that the size of transportation problem, that 
can be solved on -Analog Computer, is limited by the available number of 
integrators, which is only 24 for three TR-20 (8 integrators each). However* 
setting up of transportation problem is much less involved because of the 
unity coefficients in the LHS of constraints. This elliminates the patching 
and the setting up of number of pots , thereby saving considerable amount 
of time and effort. In this problem, to reduce the scaling factor to 
5OOO first and third constraints in ( 4 . 13 ) are divided by 2. 
x. . 

writing for i = 1,2,3 

& $ = 1,2,. . . 7 


The coefficients of the scaled LH problem are tabulated in Table 4 *^. 
Writing Z in terms of y. . and scaling it by a factor of 5000x25- 


5000x25 = Z ’ = * 43r 11 + ‘ 32y 12 + * 64y 13 + ,12y 14 + 4y 15 +y 1 6 + ’?2y 17 

+ .7 6y 21 + y 22 + *72y 25 + -28y 24 + 48y 25 + *78y 26 +*76y 27 

+ .8y 51 + .68 y^ 2 +.8 y^ + +. 56 ^ + +-68y 57 


(4.14) 




Table 4.10} Scaled constraint coefficients for example 
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4.5*2 Analog Solution? The analog computer set up diagram for table 
4-10 and equation ( 4 - 1 4 ) is shown in appendix ’D*. This problem utilized 
the following Analog Computer components (refer to 3*3)» 

(a) Amplifiers = 21 + 2x10 +2 =43 

(b) Pots = 2x14 +2x19 + 7+1= 74 

(c) Diodes = 21 + 2x3 = 27 

Using the procedure outlined in 3.1*3 the optimal solution obtained 
its tabulated in table 4*1 1* The results obtained from IBM 7^44 using DP 
package are also tabulated in the same table for comparison sake . It Is 
seen that the maximum error is about 2/^ , which is quite acceptable 

4.5.5 Post-Optimal Analysis ? The effect of variation of amount available 
at each origin on the objective function was studied at discrete points and 
plotted as 0^ , 0 2 & 0^ in Pig . 4 . 3 . The demands (Tons/day) at each destination 
(D 1 , D 2 . was also varied with the help of calibrated potentiometer 

and its effect on the objective function observed. These observations are 
tabulated in table 4 . 12 and the corresponding curves plotted as shown in 
Pig. 4 . 3. Consider the curve 0 1 in fig. 4 . 3 , representing the quantity 
available in Tons/day at origin 1. Por optimal value of Z = 121250, the 
availability desired at origin 1 (0 1 ) is 10,000 Tons/day. It is seen from 
table 4-12 and fig. 4 . 3 that any decrease in 0 1 from this value results in 
the increase in Z, thereby implying more cost of transportation. Whereas 
Z is not affected so long as 0 2 and 0^ are greater than 1000 Tons/day and 
I 5 OO tons/day respectively. Study of demand curves (D-j » reveal 
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! Variables f 

Scaled 

Analog 

Solution 

1 Analog 

y Digital 

1 Percentage 

0 error 

_J — - 

! 

§ solution 

0 

0 solution 

0 

i 1 

! x n 

.402 

2010 

2000 

•5 

i 

j x 12 

.202 

1010 

1000 

1 

1 

j x 15 

•397 

1985 

1999 

•7 

x 14 

.896 

4480 

4500 

.445 

x 1 5 

.105 

5O5 

500 

1 

x 16 

1 

0 

0 

0 

- 

1 

T 

x 17 

0 

0 

0 

— 

X ^ 

0 

0 

0 

- 

21 




X 22 

0 

0 

0 


X 25 

. .190 

990 

1001 

1 .1 

x 24 

0 

0 

0 

- 

) 

1 25 

0 

0 

0 


j x 26 

0 

0 

0 


x 27 

0 

0 

0 

" 

X 51 

0 

0 

0 


x 5 2 

0 

0 

0 


*33 

0 

0 

0 


x 34 

0 

0 

0 


x 35 

0 

0 

0 

“ 

H 

V>J 

ON 

.122 

610 

600 

1 .667 

x 

.186 

930 

950 

2 .1 

37 






z 

.97 

121250 

122250 

.81 5 


Table 4-11* Comparison of analog and, d igital , solutions for exam p l e, 5 





2000 


3 Plot of objective function vs. re 
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that increase,' in demand results in increased transportation cost and 
docre iso in demand reduces the transportation cost. It may be observed 
that the effect of increase in demand D is less pronounced in increasing 

nr 

the transportation cost. 

4 .6 Dir.cu:;s.i on* It is seen that non-uniform scaling of the variables 
becomes quite involved as in example 3 while the uniform scaling may at 
times fail to achieve desired accuracy, as in example 4* Tt is now possible 
to offer sumo guidelines fox the scaling procedure. 

(a.) To start with, scale all the variables of the given model by the 
same factor as in examples 2 and 4 and comnute the results on the 
Analog Computer. 

(b) In case the magnitudes of some of the variables are too small or 
beyond the range of Analog Computer, use appropriate scale factors 
for the affected variables and modify the scaled coefficients 
accordingly. Compute the solution with modified pot. settings. 

It is clear from the four examples that medium sized linear 
programming problems having upto I5-2O variables/constraints can be solved 
on Analog Computer with a reasonable accuracy. The solution is obtained in 
a single run m a matter of few seconds and therefore it is a reasonably 
fast method of solving LP problems. However there is one drawback. Ihen 
one of the constraint hyperplanes coincide with the hyperplane of the 
objective function, an infinite number of solutions can result. This 
situation can be checked by having 2-3 runs each with different initial 
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conditions. In LP package (IBI 7O44), use of "EHS E&HGIHG-" & "COST 
Riu'iG r£T(J " control cards will give the lower and the upper limit fox 

hj(j=1 /> J m) & (i =1,2 ...m) respectively for which the optimal 

solution bncis remain unchanged. However to observe the variation in 
objective function with the varying parameters will involve extensive 
digital computer programming* In -Analog method the variations in resources 
avail 1 , bio or the variation in cost/profit coefficients can very easily 
Le Simula bod by just resetting the relevant potentiometers. This gives 
a very valuable insight into, the practical problems and here the .Analog 
compute i' definitely has an edge over the digital computer* 
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CHAPTER 7 

HOE-LIEEaR PRQftRAMJTM-g 
5 »1 fce g^norol non-linear programming' nroh' 


ar programming problem is to find x. ,x 0 

i d n 

2 •••♦O (5.1) 


Subject to 


.raize 

Z ( 


• • * * x n ) 

to 




A 1 

Gc 1 

j ^ • 

. . . . x ) <4. 

n 


(x 1 

f x 2 . 

* * ' * ^n/ ~ 


(5.2) 


^ X 1 ’ 3c 2 ^ — 

& 0 for i =5 1 ,2 * . . * 


(* -1 y ^ 

1 <; 


x n ) and A.. (x^ ,x 2 . 


. . . x R ) are given functions of 


a decision variables. 


5*2 Analog Me thod of solution i The Analog method of solving LP problems 
c m be extended to solve those non-linear programming problems -which are 
expressible on analog computer. With slight modification writing 
equations (0.5) and (2.6) for general programming problems 


i .">r. 
'• 1 


if _£ii 

j=1 C> x i 


where 0. = <i) . (A. - b.) 

J tJ J v 


e for i = 1 ,2 . . 
J 


for j - 1,2 


. -n (5.3) 


(54) 


Term s. is introduced since in the solution of non linear programming 

0) Z 

problems, sotting of pots s may be different for different • 4t is 


clear that to instrument a ncn-linear programming problem we must be 
2 d a j 

able to compute ~~ & --it- and hence the first derivative of Z must be 
d x i C> x i 


d x i 
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defined throughout the solution space and the first derivative of A. must 

be defined in the neighbourhood of the boundary space (defined by strict 
equalities in 5.2). 

5*5 Possible types of solution? 

1 . Iho most straight forward solution occurs when the absolute 
maximum or minimum value of the objective function Z lies within the region 
specified by the constraints on • • • • x * In this case the constraints 

du not play any significant part in the solution. This is only possible for 
0, nonlinear objective function as the very nature of this type of solution 
implies the existence of stationary points in a domain. For this type of 

3 z 

non -linear programming problem, the conditions -=r = 0 are satisfied and 

a x i 

.integration ceases precisely when the x^ give the maximum/minimum value of 
the objective function. 

‘2. When the absolute maximuro/minimum value of objective function 
Z lies outside the restricted region, the solution is entirely determined by 
the constraints A. b . for j = 1 ,2 . . . . m. 

The x^'s will be driven in the direction of maximum/minimum value 
of Z(x) until a constraint boundary is encountered. Further motion is 
along the boundaries of the restricted region until the objective function 
is maximize d/minimized. In practice an exact solution to the problem is 
never obtained for the following reasons* 

(a) - — 1 1 can never be made zero since global maxima/minima 

lies outside the region defined by constraints. 
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(b) To make the input to the integrators as zero (for steady 
state solution), an error voltage is required to cancel i.e. 

more of the constraints being minutely violated. 


one or 


Due to the characteristics of diode feed back circuits providing 

>■ i> amplified error voltage Ke. this violation in constraints is very small 

J 

end the overall error does not exceed 1-2$. 


5 *'1 Difficulties associated with non-linear programming 5 

A s pointed out in chapter 2, solving nonlinear programming 
problems on the analog computer present two main difficulties. 

(a) Non-linearities when described on analog computer require more 
elaborate equipment in the form of multipliers, Deviders and function 

•ni\uv; tors etc. which restrict the size of nonlinear programming problems 
that con be solved on Analog Computer. 

(b) Non linear programming problem may have a number of local 
maximum (Minimum) values which will ".arrant sufficient scanning of the region 
of interest to arrive at the absolute maximum/m in imum. This is illustrated 
by a simple two dimensional example. 

d « $ Example 6 { * 

Maximize Z = 25 (x^-2) + ( x 2 -2 ) (5*5) 


s 


•’‘Hadley, G., "Nonlinear & Dynamic Urogramming" pp 11-12. 
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Subject to 

= - x 1 + x 2 2 

^2 = *5x 1 + . 5 x 2 <3 

^ = .333x^x2^.667 (5.6) 

A 4 * *1 + * 2 * 2 

& x^ , x 2 0 


The geometrical representation is presented in Pig. 5 . 1 . It may be seen that 
the extreme point (J)yields the global maximum of the objective function, 
however extreme point( 2 ) yields a relative maximum of the objective function 
different from the global maximum. 


5 . 5.1 Scaling * 


Writing 

y i = 

" in (5.6) 

p i 


-P 1 y 1 + 

p 2 y 2 

*==: 2 


* 5 P 1 y 1 + 

• 5 P 2 y 2 

^ 3 

( 5 . 7 ) 


• 333P 1 y 1 “ P2 y 2^ * 66 ? 

p 1 y 1 + p 2 y 2 2 


Dividing each constraint of (5*7) "by 5 snd- taking - P-j - 5 * the scaled 
problem is recorded in table 5.1. Expressing the objective function in 


terms of y^ 

Z = 
Z 

1250 


25 (5y 1 -2 f + (5y 2 ~ 2 ) 2 

- = Z’ = .02 (5y 1 -2) 2 + .0008(5y 2 -2) 2 


or 


(5-8) 




Fig. 5-2 Analog schematic for example 6 • 
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Constraint! 

! Variables 

Specification 

No. ( 

i 

* i 

y 2 

1 

-1 

1 

^ #4 

2 

•5 

•5 

^ .6 

! 5 

j -335 

! -1 

! 

^ *1334 

: 4 

* 

L, 

1 

1 1 

1 

1 

\V 

» 


Table 5 . It Scaled constraint coefficients 
for example 6 . 


The partial derivatives of Z' with respect to & yg are 


' 2 « 



• ,y i 

\ 

z 1 


y-i -*4 

.04 y 2 - .016 


(5 =9) 


[) .5 .2 Analog, Solution? 

The scaled problem in table 5*1 and equations ( 5 * 8 ) and (5-9) 

are inctrunvnte.d on the analog computer as shown in Fig. 5 *2. To obtain the 

optimum solution of nonlinear programming problems, procedure outlined 

in step 5 of 3 .I .5 is slightly modified while setting the various s 

pots. Unlike in LP problem solution, where there is only one s pot, 

solution of nonlinear programming problem on the analog computer may 

involve n number of s- pots to be set individually. The pots s. may be 

X 


set in the following steps. 
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1 . Initially keep the setting of all pots as unity and put the 


analog computer from "Reset" to "operate" 


2. Vary a^,at the same time observe 


c>2 


3y 1 


. The desired setting of pot 


s„ is the one that gives minimum value of . However in certain cases 

1 3y 1 


dZ 

3z 


or thing of the pot. may affoct other 

o y 


In. that case all such 


t* Z 

3 y. 


should also he observed for a minimum value. 


3 . Stop 2 is repeated for setting of other s^ (i =2,3 . ...n) pots. 

Thus several computer runs were made using modified procedure 
,■ ! nd vith different sets of initial conditions. It was observed that whenever 
the- storting point was in region A (fig. 5*0, the local maxima point(0was 
oh hr lined but with the starting point in region B, the global maxima point 
0 arrived at. The solution obtained with starting point in region A is 


x^ = . 4 OI x 5 = 2 .OO 5 

^ • 0 

whereas the solution obtained with starting point in Region B is 

x 1 = .995 x 5 - 4*975 
x 2 = .201 x 5 = 1*°°5 

vhich is the global maxima for this problem. 


5*6 Convexity and concavity*. 

It is at times worthwhile to test for the convex! ty/concavity 
of the objective function and of the constraints of the non-linear 
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programming problem. For the cases detailed below the local optimum 

point io also tho global optimum point and hence no scanning of solution 
apace is necessary. 

(a) A maximization problem where the objective function is concave 
and the constraints are concave/linear . 

(b) In a minimization problem when the objective- function is convex and 
tho constraints arc convex/linear. In appendix 'S’ the necessary and 
sufficient conditions for convexity/concavity are explained and a 
general scheme for assessing the convexity/ concavity of functions 

of more than one variables is given with example . Three typical 
non linear programming problems that were solved on the TR-20 will 
bo discussed now. 

5*7 Fbraniplo 7 (quadratic pr ogramm ing ) 


Quadratic programming problems are special class of non-linear 
programming problems in which the constraints are all linear but the 
objective function io of the quadratic form. 


Maximize Z = (l2 )x. + (8.4-2x 2 )x 0 + (ll .2-2x^)x^ 


Subject to i 


+ (7-7-x 4 )x 4 + (l0.4~x 5 >x 5 


7‘lx^ + 6. 2 x 2 + 5 *2x^ + 6.5x^ + 7.4x<- 

5 » 7 x.j + 6 .5X2 + 6 .8x^ + + 6 

2 .2x^ + 2 -5x 2 + 5x^ + 3 + 1 


^ 20 
20 

<; 25 


(5*8) 


( 5 * 9 ) 


*■ Vajda, "Readings in Mathematical programming" pp 117 
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5. 7*1 Scaling* 

X • 

Dividing ( 5 . 9 ) by 10 and writing y. = 

1 2*5 

thy scaled constraints are tabulated in table 5.2 


Constraint 
No. i 

— 



Variables 


| y i ; 

y 2 { 

y 3 

! y 4 1 



1 

.71 

.62 

•52 

.65 

,4 

.8 

2 

• 51 

.65 

.68 

•5 

.63 

.8 

5 

i 

.22 

.25 

.3 

*35 

. 13 . | 

j 

1 

1 

Table 

5 *2* 

Scaled 

constraints coefficients 

i for example J 


Writing Z from (5-8) in terms of y^ and dividing Z by 5^ 


vjo get 

- Z» - (.605-,l25y 1 )y 1 + (.42 -. 25 y 2 )y 2 + (.56-.25y 3 )y 5 

+(.585-.i25y 4 )y 4 + (.52-.l25y, )y 5 

D.L f P cu 'unci; 1 1 ing Z ! 


■>Z' 

sa 

. 6 O 5 - ,25y. 

c 1 y 1 



0z f 


. 4 2 -. 25 y 2 

,yy 2 


^ z 1 


.56-.25y 3 

ay 5 


B z* 


•385-.25y 4 

By 4 


dz 1 



By, 

s= 

.52 -.25y 5 


(5*10) 


(5.1l) 
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5 * 7»2 Ana log Solution? 

The Analog Computer diagram to instrument the scaled problem 
represented by table 5*2 and equations (3 • 1 0 ) and (5.11) is shown in Pig. 
5.5. Modified procedure as outlined in 5 *5.2 was followed and the results 
obtained arc tabulated in table 5 * 3 " Digital computer results are also 
tabulated alongwith for comparison. 


Variables 1 
{ 

Scaled 

solution 

| Analog 
j solution 

! Digital solution 

l Error 

X 1 

-593 

1 

1 .4825 

— — — 

1*47 

! 

• 85 $ 

*2 

.O43 

.IO75 

.10 

1 

7 * 5 $ 

z 3 

1 

*456 

1.14 

i 

1.13 j 

i 

.88/0 

X. 

4 

0 

0 

1 

0 ; 

j 

- 

x 5 ! 

L 

-1 65 

! i 

.412 

.42 j 

1 

1 . 9 ^ 


Table 5.5s Comparison of Analog & Digital solutions for example 7 

5 - 7*3 -Effect of Varying HHS elements: 

The effect of variation of RBS elements on the objective function 
wan studied at discrete points. One element of RHS vector was varied at a 
time with the help of calibrated potentiometer and the corresponding 
objective function values recorded in table 5 * 4 * The values of the variables 
were observed simultaneously and any changes from the basic feasible 
solution recorded in the remarks column of table 5 * 4 * The variations 


are plotted in Pig .5 *4 







10 V 

-0 


/ ~ @9-— H0V. 


Analog 


ci c'-natic for e 








e'.ij . i . J t 


2 ° Sl/\p „ 
rncr.-^ 5- 1 -? 
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Table 5.4s Record, of the effect of variation in b. on 
the o bjective function (z) 

It is seen from table 5.4 and. Pig. 5 *4 that increase in value of 
bj does not improve the value of the objective function. Infact b^ can be 
reduced from 25 to 7.5 without affecting the value of Z. A further increase 
in b 2 from 20 results in a nominal increase in the value of Z to 31 .95 


Objective function 







mm pm 

n-. 


m . § 
i gray: 

HI a® 
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and iiJ constant thereafter with further increase in bg. However increase 
in b^ from 20 does result in increase of the objective function. It can 
bo pointed out that any reduction in the value of b^ from 20, 
results in reduction in the value of the objective function# 

5*8 Ehcample 0 

Wo now consider an example in which both the objective function 
and the constraints are nonlinear. It will be seen that patching up of 
n unilinear constraints on Analog computer requires a more elaborate set 
up to cater for the nonlinearities in the constraints as well as in 

computing the partial derivative of A.*s. 

3 


Minimize* Z * 

2 2 ? 

*= x 1 + 2x^ + x^" - 5x 1 - 5 x 2 - 21Xj + 7 x 4 

(5-12) 

subject to 



A 1 

2 , 22,2 


* *1 + *2 + *5 + *4 + *1 - *2 + V *4 &' s 

( 5 . 13 ) 

k 2 

“ 2x^ 2 +x 2 2 + x^ 2 +2x^-X2 - * 4 5 



5.8.1 Scaling* 

x i 

Writing y 4 = 2 — in (5*13) and dividing it by 20 
wo get 

.2y 1 2 +.2y 2 2 +.2y 5 2 +.2y 4 2 +.1y 1 ~^ 7 2 +A ^ Aj 4 - 4 

9 o 2 ( 5 . 14 ) 

•4y., +.2y 2 +.2y 5 +.2y 1 -.1y 2 -. 1 y 4 <.25 

The Jacobian matrix J(A,x) of set of function A(x) is defined by 


* 11 Operation Research 11 Vol*l7*2> 1969* PP* 97® 
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Tho Jacobian matrix J (A,x) of set of function A (pc) is defined by 


1) ^ 

A^ 

a a. 

d x 1 

Ja ' ' 

3*n i 

A A 
u \ 

^ A 2 . . 

. . ! 

C> x i 

i 

1 

r) x 2 

■3^ ! 

s « • 

( j li 

J m 

f) A 
in 

> D 

1 ^ x i 

d x 2 ’ * 

• • • 3^ ! 


and 3 n required to bo computed in the feed back circuits of programming 
problcmn having nonlinear constraints. For this problem from (5-14) 


1 . 4 x ^+1 4 x 9 -.1 . 4 x ,+1 

J(A,x) - I 5 

j .8x^.2 . 4 x 2 -.1 4x3 

Writing Z from (5 .12) in terms of y i and scaling it, we get 



■ Z’ *- .06y 1 2 +.l6y 2 2 +.08y 4 2 -.2y 1 -'.2y 2 -.84y 5 +.28y 4 


Differentiating Z‘ 
. 1fy _ 2 
^Z' 2 

C> 7, * 

70 •3‘2-7'z “*®4 

dy 5 5 

d z t 

** .I6y, + *28 

c?y 4 4 


(5*16) 


(5.17) 



71 


5*0.2 Analog Solution* The Analog computer diagram instrumenting the 
scaled problem represented by relations (5.14), (5 .15) & (5.I7) is shown 
in Fig. 5. 5 * This problem utilized 40 amplifiers with seven multipliers, 
four squarurs and 58 potentiometers. The optimum point was obtained by 
using modified procedure outlined in 5*5-2 and the results are tabulated 
in table 5-5 alongwith the digital computer results. 


Variables 

! 

Scaled ji 

Analog a 

solution jj 

Analog 

solution 

| Digital jjT 
^ solution 

J L 

— 

Error 

x i 

0 

0 

0 


- 

x 2 

•515 

1 .05 

1 


Jfo 


1 .00 

2 .00 

2 


Hil 

x 4 

-.494 

-.988 

-1 


1 .2/0 

1 Z 

* 

-44.8 

-44 


I-&1 % 

L - - 

Table 5.5* 

flnjppriT] son of Analog & digital solutions for exarnple^ 


5.8.5 Effect of Varying HHS Elements ! The effect of variation of EHS 
vector on the objective function was studioc 1 at discrete points with the 
help of calibrated potentiometers and the corresponding values of the 
objective function recorded in table 5*6. Remarks column of table 5*6 
indicate any changes that occur in the basic feasible solution. These 
variations are plotted in Fig- 5 - 6 . 3 h ^* 5 * 6 , negative of the objective 
function is plotted against b 1 and b 2 , because the optimum value of Z is in 
the negative range. It can be seen that the value of the objective function 





Fig. 5 >5 Analog computer set-up for example 8 • 
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b^ jj Z | Remarks | 

2 | Remarks 

2 } } 

2 -IO.I75 

0 -29.7 

3-8 - 35-85 x {tj > 0 

2 -35.9 

4 - 44*25 x 1 >0 

4 - 42-5 

■ 6 - 44*75 

5 “44 -8 Optimal 

0 -44.8 Optimal 

6 - 47*1 

10 -44.75 

7 -49.25 

12 -44.7 

7*5 “ 49*9 

14 -44.4 

8 -5O.5 x 1 >0 

: 16 -44*5 



Table 5.61 Record of the effect of the variation in. 

b- (j=1 , 2 ) on the objective function (z) 
mJl - - - - — — 

can bo significantly reduced by further increasing the value of b 2 from 

5 , whereas an increaso/de crease in b^ from 8 increases the value of the 

I'b.jcctive function. 

5 .9 Optimum Generator Allocation* This problem forms part of load flow 
studios of power networks. The total amount of real power in the network 
emanates from the generators, the location and size of which are fixed. 

The genera ticn must equal the demand plus the losses at each instant and 
this generated power must be divided between the generators in a unique 
ratio in order to achieve most economic operation. The optimality criteria 

•in terms of transmission losses, "both of which 


may be in terms of cost or 








■■■ 

Sia 


lllilillll 
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can be expressed with fair accuracy in terms of real power generation. 

It is always necessary to keep the voltage levels of certain buses at 
close tolerances, which is achieved by proper scheduling of reactive 
powers. The reactive generation in general does not have significant 
influence on the cost or transmission losses because they are controlled 
by varying the field excitation. Thus excluding the reactive powers and 
associated voltage profile from our nonlinear programming problem we can 
state the nonlinear enstraint that must be satisfied at all the times 

IZ p i“ E »- p i -° (5 - 1s) 

i-1 


where 

n 

"V p « Total real power generation at 'n f generating stations 
i-1 

m 

P „ v-- < p „ Total real power demand from m loads . 

B , Hi 

i«1 


p «a Total real power Transmission losses. 

L 

Those transmission losses can be expressed in terms of generated powers 
by T^nsmission^loss formula 


i.c \ - 

i 3 


P. B. . P. 


where 



source loadings 

Transmission-loss formula coefficients 
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5.10 Example 9* Wo consider a 5 "bus problem as shown in Jig. 5 .7* 

8 6MW/ 

The reactive power and associated 


'-w 


\ 


voltage profile is fixe^ for each bus.V 
Thc real power demand at each bus is 
indicated in Fig. 5 -7* It is required 
to find generations Ej j P 2 & in order \5.' 
to minimiKu transmission losses. The 
loss coefficients for the system are 
assumed to bo known. 


.—ft- 


■ 

/ 

V* 


> 1 


•I-” 


fP 2 

4 ^ 

V — > 


46.8 MW 


I 7 . 4 MV? 


I 1 © © 


1 ' 

36.2MW 


% 



Fig . 5 . 7 * Beal power demand at 5 busses 
The transmission looses expressed in terms of loss co-efficient 


formula arc* 


\ " P 1 2 B 11 + P 2 2 B 22 + ? 3 2 B 35 + 2P 1 P 2 +B 12 + 2P 2 P 3 B 23 +2? 3 P 1 B 31 ■ 

(5.19) 


where 

B 11 

.02725 


B 22 

.0309 


B w* 

55 

.323 

B 21 * 

B 12 " “ 

.0035 

B 31 ” 

1 B 13 ' - 

.O 36 C 

B 32 " 

' E 23 ■- 

.00565 


( 5 . 20 ) 


All powers arc 


expressed as p.u. 


taking 200 MW as base power. 


*Kirchmaycr, L,K, Economic operation of power system, pp.118. 
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^SSjLgil Solution * The problem can be expressed as:- 

Minimize Z » .02725?^ + .OJOJ^ 2 + .323Pj 2 

- .007? 1 P 2 - .0113?^ - .0736?^ (5-21 ) 

subject to the constraint 

L - P^Pg+P - (.43+.234+.I8I+.O87) - .02725?^ 


“ .0309P 2 2 

- .323P ? 2 + .007 ? 1 ? 2 +.0113P 2 P 5 +.0736P 3 P 1 = 0 

(5-22) 

We write 



0 z 

~Sh 

.0545? 1 - .0C7P 2 -.0736P 5 


O z 

H ■ 

.061 8P 2 - .007P 1 - .0113P 5 

(5-23) 

py c ) 

fl 

.646P 5 - .0113P 2 - .073 6P 1 


kl3<. Oi 

^ P 1 

I-.0545 P t + .007? 2 + .0736P 3 



1-.0618 P 2 + .007 P 1 + .0113 ? 5 

15*24; 

4. 

’B p 3 

I-.646 P ? + -0113 P 2 + .0736P 1 



The Analog computer set up for this problem is siown in Pig. 5*8. 

This problem utilised 26 amplifiers with 6 multipliers 3 squarers smd 32 
pots. The optimum solution was obtained by using modified procedure 
outlined in 5-5.2. The result obtained are tabulated in table 5-7 alon S 
with the digital computer results. 




Fig *5*8 Analog schematic for example 9 
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I i 

Variables ! 

^ Scaled I 
j Analog ; 

| s olutinn £ 

| Analog I 

1 solution | 

1 Digital | 

) solution 

; p i 

.67 

134 MW 

144 MW 

*2 

,12 

24 MW 

10.668 MW 


.157 

31 4 MW 

34.6 MW 

Table 5 

•7* Comparison of Analog & Digital solutions 
for example 9 - 


Total optimum generated power =* P^+P^+P^ = 189 .4 MW 

Total Demand . . = 186 . 4 MW 

Hence Total Losses P L «* 189. 4-1 86.4 ~ 3 MW 

Vftioruns, as calculated from objective function ( 5 . 21 ), P L » 2.62 MW. 

Tide discrepancy in ? L is attributed to the small 'error voltage ' tha t 

incur in the solution of Analog Computer. Since the total demand ? D 

varies with time, this aspect can be taken care of by varying the 

npprr printe pot. setting and observing the new optimum solution. Thus 

plot can bo made of P.'s for different values of loads. 

1 

5.11 Discussion * It is clear from the examples that nonlinear programming 

problems which are expressible with the available analog computer 

components > eon be solved on analog computer with ease. The size of 

that 

non linear programming problem^an be solved on analog computer is 
restricted by the available nonlinear components e.g. multipliers, 
dividers and function generators etc. Some of the nonlinear programming 
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pri 'bli.i:'S may nuod sufficient scanning of the solution space to 
arrive at the global optimum. In certain cases the test for convexity- 
concavity docs uliminate the scanning process. A logrithmic function 
gcnorat'ir was assembled from the data given in "Maintenance Manual for 
TR-20". Hi.;, details are given in appendix ! F.’ 
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CHAPTER - 71 


6.1 The Analog computer method described in the previous chapter can be 
used in solving a variety of optimization problems that occur in many 
industries. The use of this analog method with slight modifications can 
also be extended in solving 

(a) Simultaneous algebraic equations 

(b) Matrix inversion problems 

6.2 Simultaneous Algebraic Equations • 

A set of simultaneous algebraic equations can be written as, 

a 11 X 1 + a 12 x 2 + a 1n x n “ 

a 21 X 1 + a 22 x 2 a 2n X n “ b 2 ^ 


a r1 X 1 + a n2 x 2 


+ . 


a \ 


which may be expressed in matrix form as 
AX - B 

(6.2) have a solution, the determinant | A jmust be non- 


( 6 . 2 ) 


In order that 
vanishing 


For solution of (6.1 ) on the analog computer, the set of equations 
.0 first transformed into a set of differential equations as 


+ a^ 2 x 2 + * * * 
*21 X 1 * a 22 X 2 + ’ * * ' 


* a 1n x n " ^1 
* a 2n *)a. ^2 


i 

- X H 


= - Xr 


' (6.3) 


nl X 1 + ®ta2 *2 


4 * * 


a nn "^n 
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I!he IHS of each equation of (6.3) represent the input to 
an integrator having one of the unknowns , Xg ......x^ as its outputs 

Ihe use of integrators would ensure that all residual errors due to the 
method of analog computer set up would be zero. This reduces to the 
original set of equations when all derivatives are zero. The matrix 
operation being performed is 

: A + si i X » B (6.4) 

The Analog Computer is being used to solve a set of n simultaneous 
differential equations. The stsmdf state solution of which (if it exists) 
will be the solution of original set of algebraic equations. The Analog 
Computer set up ia then a dynamic system described by (6.4)) the 
stability nf which may be determined by finding the roots of the 
characteristic equation. 

dot | A + si | *» 0 (6.4a) 

l. 

The dynamic system described by (6.4) will be stable only if all the 
roots s-j» 82** • • of (6.4a) have negative real parts i.e. if matrix 
A 1b positive definite. 

6.2.1 Analog sot up* 

T . 

If A is a nonsingular square matrix of order n, then C = A A is 
always positive definite* . Therefore the concept of premultiplying by 
the transpose of A always lead to a stable computer system* if a solution 
exists. Therefore expression (6.2) becomes 


* Hausner, A. "Analog & Analog/hybrid computer programming, 

Theorem 11.8 pp* 522. 
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T T 

A A X « A B 


(6.5) 


This cot is then transformed as in expression ( 6 . 3 ) into a set of 
simultaneous differential equations 

A T A X - A T B = ~X (6-6) 


The computer set up corresponding to expression 
since all roots of the characteristic equation 


(6.6) is always stable 


rp 

A A + si 


ire 


real negative (the matrix A^A is positive definite). Using analog computer 


one can proceed in two different ways, 

T T 

(a) Calculate* the new matrix A A and the column vector A B and set up 
the set (6.6) on the computer. This will require only n integrator for the 
set up. For sets having a large number of unknowns, a considerable amount 
of calculation has to be carried out before starting the proper solution 

on the computer. 

(b) The multiplication of A 1 can be performed on the Analog computer 


by solving 'two sot3 of equations 
AX - B = e 


(6 .7a) 


A T e 



(6.7b) 


which are equivalent to the original set (6.6). A general set up diagram 
for expressions (6.7a) & (6.7b) is shorn in Fig.6.l(a) and (b) respectively. 
In order that the error voltages H are very nearly reduced to zero, they 
are multiplied by large constant K (usually 10 or 100 ) before being fed bach 
to the integrators. The Analog Computer set of Iig.6.1 differs from 
Tig.2.1 in the following respect. 
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Fig. 6.1* Rartial diagram for general method of solving 
simultaneous algebraic equations 


(a) Diodes are not used in Fig. 6.1 
(li) Partial derivative of objective function C 
from Fig. 6.1 for obvious reasons. 


c>Z \ 

3*1 


is omitted 


6.2.2 Improving Accuracy * 

If more accurate results are desired than obtainable with Analog 
Computer set up of Fig. 6.1, an iterative procedure may be used to improve 
accuracy, let the values of 's obtained by computer be represented by 
column matrix X' and let the error be represented by column matrix E. 

OJhen the correct result is 


X a X* +E 

and the matrix operation desired is 


i .e . 


AX - B 
A jx* +E 


B 


or AE 


B - AX 1 


( 6 . 8 ) 
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Thus with the values of X* obtained from the computer set 


column matrix 


B - AX’ 


can be calculated and the values 


up, the new 
of these 


elements substituted for the BBS coefficients B in the same computer 
set up. The corrected values of column vector X are then obtained by 
adding the newly computed value of error vector E. A simple example will 
illustrate the analog method. 


6.2.5 Example 1 9t 


Solve 


+ 10 * 2 + x 3 

ss 

10 

2x^ + 20 x^ + x^_ 

** 

10 

3x 2 + 30 x 5 + 3x 6 

*35 

0 

1 0x.j + x 2 “ Xg 

m 

5 

2x 4 - 2x 5 + 2Qx 6 

- 

5 

x 5 + I0x 4 - x 5 

BSt 

0 


To scale it, each equation of 6.9 is divided by such a 
constant so ss to make all the coefficients less than or equal to 
unity. Those scaled equations from (6.9) are written in the 
matrix form as follows* 



86 


.1 

1 

.1 

0 

0 

0" 


x i 

f 1 ‘ 

.1 

0 • 

1 

.1 

0 

0 


*2 

1 .5 

1 ^ 

0 

.1 

0 

0 

1 

.1 



1 ° 

1 1 
i 

.1 

0 

0 

0 

1 

“•1 ; 

1 

; 

x 4 

! 

: - j .5 

0 

1 

0 

0 

.1 

-.1 

1 

1 1 

! 

j 

! 1 

1 X - 

i 5 

t 

! i * 2 5 ! 

i 0 

L 

0 

.1 

1 

-.1 

1 

0 : 

: 

i Xs 

L 6 - 

1 5 

» 5 0 

! L— 


The sealed computer diagram corresponding tc (6 . 10 ) is shown 
in Pig. (6.2). With the first solution vector X f for K = 100, vector 
|^B - AX * } wa* calculated and the error vector obtained in the second 
run. The corrected results are tabulated in table 6.1. The digital 
computer result arc also tabulated for comparison sake. 


Variables 

A inalog solution corrected 

A by one iteration 

1 Digital solution 
$ 

X 1 

.432 + .0005 

- *4325 

•43335 

x 2 

.911-. OOO5 

“ .9105 

.9IC7I 

x 3 

.461-.002 

“ -459 

•45954 

x 4 

-.05 -.00 6 

** —.056 

-.O575O 

x 5 

-.101 -.012 

- -.113' 

-.11549 

x 6 

.2495-. OO65 

“ -243 

.24420 


Table 6.1s Gumparison of analog & digital solution 
for example 10 
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6.3 Matrix Inversion* 

Matrix inversion on Analog Computer can be accomplished in the 

same ■way as the set of simultaneous algebraic eouations ore solved. 

—I 

Elements of A are computed from 

Air 1 - i (6.ii) 


■6et A » E then 6.11 beccmes 


a 11 

a 12 * * * 

* * a 1n 

1 

k ll 

k 12 * * 

» 

• 

— l- 

P 

1 

1 

1 

1 

0 . . . 0 | 

! 

a 21 

a 22 * * * 

* * * a 2n 

| 

j 

*21 

^22 * * 

* * ^n 

! 

° 

i 

* 

• 

• 

O 

• 1 

* • • 4 

• « * 

j 

; 

« 

* « 

• » • 

s= ' 

• 


Vi 

w 

a n2 * * • 

• * * s 

rrn 


k , 
nl 

n2 

. . k . 

nn 

J 

i 

i 

|° 

*— 

0 . . . . 1 


which can be written as nxn linear algebraic equations. The first 
n equations are 

a 11 k 11 + a 12 k 2l + a 1n\i1 

Vi k 11 + a 22 ^21 + * * * * '* a 2n k n1 

• ••*••••• # • * * • * * • ♦ * 

Vl k 11 + V2 k 2l + a nn ^nl “ 0 

Sot (6.12) when solved on analog computer as described in section 6.2 
will solve for the first column of matrix Kb Other columns of matrix K 
can eaa. il y be computed, one at a time, from the same analog computer set 
up of (6.12) by proper substitution of unity elements on EHS. Thus in 
n run 3 inverse of the matrix A can he computed. 


- 1 

- 0 (6.12) 
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6.4 Discussion » 

Analog solution of simultaneous algebraic equations is 
advantageous in cases ushere there are several sets to he solved with 
the same matrix. The Analog Computer components required for this set 
up arc 

(a) Amplifiers *= 3& + m 

(b) Potentiometer =* 2g + h 

where ijl 13 number of rows plus columns containing negative coefficients 
n ~ number r'f variables in the problem 
g «Non zero elements of matrix A. 
h “ Non zero elements of column vector B. 

With proper scaling, a largo number of elements of matrix A can be made 
unity thereby reducing the number of potentiometers required for the 
net up, which otherwise limit the size of the problem set that can be 
ivr-1 m analog computer. The use of external equipment for additional 
iii} tuts nnd additional coefficients potentiometers designed in Chapter II 
rind prrnor scaling can easily result in the solution of problem with 10 


variables ur so. 



CHAPTER 711 


CONCLUSION * 

A simple, fast and reasonably accurate method of solving 
medium sized Linear & Won-linear Programming problems using the Analog 
computers TR-20 has been described in detail alongvith a number of 
illustrations. She main limitation cf this general purpose Analog computer 
in solving programming problems, is the limited number of available 
potentiometers and the availability of restricted number cf inputs to each 
amplifier. Hi is has been partially overcome by the use of an external 
equipment, designed from the indigenous components to allow variable banks 
of sixty additional inputs of gain 1 and gain 10, alongwith sixty additional 
potentiometers. Hie time required in setting these external potentiometers 
can bo cut down by the use of "single press, double threw" switches. Hiis 
press button switch can be connected in such a way that, in its normal 
condition, the input is connected to the external pot, which gets disconnects 
on pressing the switch and instead -10V is applied to the potentiometer 
to facilitate the pot. setting. 

An important aspect in obtaining the analog computer solution, 
is the scaling procedure, which has also been described for linear and 
n to- linear programming problems. 

For linear programming problems and some of the non-linear 
programming problems, the Analog s*tnti«n is quickly obtained in a single 
run, in a matter of few seconds. However, sufficient scanning of the 
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solution space to find global optima is nescesitated for a large number 
of non-linear programming problems, which too can be carried out in a 
relatively short time. 

In the Analog Computer method dc-jcribtd, the effects of 
variation of model parameters on the objective function are readily observed 
by adjusting the relevant coefficient potentiometer. Thus one can very 
conveniently explore the sensitivity of the solution as a function of 
system parameters and/or observe the effects of changes predicted for 
future on the system itself. This gives a very valuable insight into the 
practical programming problems and here the Analog Computer definetely has 
on edge over the digital computer. 

Analog computers have been pushed into the background with 
the advent of digital computers. However, digital computers, at times, are 
not easily available and readily accessible . Moreover the cost associated 
v/ith the' use of digital «pmputer is quite exorbitant. Analog computer 
on the other hand, is not so expensive and its flexibility combined with 
ease of progr ammin g provide theoretical-cum-experimental approach to gain 
a real insight into tho behaviour of the system under study. Therefore 
with limited accuracy as its limitation, it can prove to be very useful 
in obtaining a first order solution to be refined later on. 

A further study of other optimization techniques given out 
in ( 4 )* end (6)* using Analog/hybrid computer would motivate the design of 
more equipment to further enhance the capabilities of available TR-20. 


^Bibliographical references* 



92 


BIBLIOGRAPHY 

1. Albow & G. Brigham, ’’An Analog solution of programming problems' 1 
operation Research V0I.3, Ntv. 1955, pr.338. 

2 . Borsky V. & J, Matyas, "Computation by Electronic Analogue Computers" 
Iliffe Books Ltd. 1968. 

3» Firth, AW, "Optimization Problems s Solution by an Analog Computer" 
computer Journal, Y0I.4, 1961, pp. 68, 

4. Hausner, A. "Analog & Analog/hybrid programming", Prentice -Hall Inc. 
1971. 

5* Jackson, A.S., "Analog Computation", Mo-Graw Hill Book Company Lac. I960 

6. Korn, G.A. & T.M. Kom, "Electronic Analog & Hybrid computers", 

Mc-Graw Hill Book Company Lac. 1972 • 

7. Longley, D, "An Analog Computer application in operation Research", 
Elect, Ehgg. , Vol.36, June 19C4> pp. 378-381 • 

0. Mc-Millon, C. Jr., "Mathematical programming", John-WIley & Sons, 1978* 

t 

9. Eyno, I.B., "Linear programming on an Electronic Analog Computer", 

ALEE Transactions (Part i) Vol.75> 1956, PP*139* 

Other related papers t 

1. Eilon S & D.P. Leziel, "The use of Analog Computer in seme OR problems", 
Simulation, Sept. 1967 PP*121 . 

2. Neustadt, L.W. , "Application of Linear & Nonlinear Programming 
Techniques" , Proceedings 3^6- International Analog Computation meeting 
Sept. 1961. 

3. Moser, J.H. etall, "Non linear programming technique for Analog 
Computation", Chem. Engg. Prog., Yol»57> l ^ aru ^961 . 



10v APPENDIX 



















SSiRg 


V • • •• n 

f. fi? .- ^ 


' *S ';•- 

• . •> • 


mm- 

- 3 : ! i 

■ • - ■■-; v 


& * • >* • * - 




?»*?&! 


aK!^\ * vy-i . v. / ^ 

■ ■ 

■p ■ 

Hsw'f .”- ^ ssg^ gs-s 

Ml MB'S SMSAiS-'' Sim 




















' v * 


cr) COCO CO 
^ CNCO >4* 















■I; 








; ;.( 


. -'vvv 

' "K J"- -• V *4% 

<£t •• , ' ..." : . 5 . .i ;*■ 


rmmmm 

&C<} 


■Jalglii 
Wmm ■■ I 




^ cm co st in id c^* 

CM CM CNCM CM CM CM 

M >* >* >>>* >* >» 


CM O0 MT lO CD CM. 
TO CO CO 00 .CO CO CO 
>- 3K>* >* >* >v >> 


cm co <r yo^r-* 















97 


APPENDIX «E' 


TESTING FOR CONVEXITY-CONCAVITY 


A function of one variable f (XJ is a convsr function if 
for each pair cf values of X, say X 1 & X" 

f [>X’'+(l-A )x*j < >f(X») + (l ->)f(X ! ) (l) 

where 0 ^ /) 5~ 1 

It is strictly convex if the strict inequality holds in (l ) 
If £ in (l) is replaced by ^ , then f(x) is a concave function. Again 
for the strict inequality the function is strictly concave. KLg.5.1 
shows a convex function. f(x) 

t 

£ f , f(X')1 is a point on j f ^ f(x") 

the curve and \ X” t f (X M )~j is i N~ - 

another point on the curve both 

t f which are connected by straight ! j ! 

_J i j 

line shown dashed. 5he expression 0 t -jr» X" 

jXX u +(l-/' )X ! , )f(x*)J Pi€* E * 1: Convex function 

represents -Hie points on the dashed 

line between points j X’, f(X’)j and (x" , f (x" )j , 0 or 1. ^hus 

all the line segment connecting the two points lie atove the curve 

of f(x). A convex function is always bending upward. A concave 

function always bends down word as shown in Fig.E.2. 
f0$ 

— f(X") 




(X) 



X 


O' x* r* 

Fig.E.2* Concave Function 
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n variable function* 

To assess convexity “concavity of a function of n variables 

» ^2 * * * X n ^ ’ WG the determinant rf the matrix nf second 

order partial derivatives 



o 2 f 

3 2 f 


5 b 2 

3^3*2 

■3 X 1 ^ \ 

3 2 f 

3 2 f 

. . . c ,2 f 


~.N X ^ 

-| u a 2 

3x 2 3x n . 

o> 2 f 

d 2 f 

? J 2 f 



3x 2 

IX i 


The principal minors of the matrix of second order partial derivative are 
then identified ass 



. C)2 f 




w 



\d 2 f 

32f 

c)2f 

1 At 2 

| 

1 

3x,B*> 

?)X 1 0X 5 

3 2 f 

c) 2 f 

3 2 f 


a*? 2 

3*23X3 


^ 2 f 

c* 2 f 





3 2 f 

3 2 f 

3^ 2 

3 b -3b 

3 2 f 

C) 2 f 

3x 2 3x 1 

^x 2 

w/A 2 


Zb 

n 
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The function in convex if XXj > 0 , /\^ > o . . . 

The function is concave if <1 0 , 4>> 2 ^ 0 » 

(i .o . o&d minors are XI 0 & the even minors are o) 


Example * 


f - X., 2 + 2X^ + X ? 2 + ^Xg - 2X ? - 7X 1 +12 


c) f 


9 x 1 

9f 


3 


*2 


- 2X 1 + X 2 - 7 


4^ 


+ x. 


~o> 2 f 

9^ 


= 2 




9> x. 


C> 


0 x 3 


fcX^ - 2 ; 


3*. 


3i, 


9 *, 9*2 




9 *, 3 ^ 


0 2 r 


3 *2~d^ 


\ 2 

O f 




1 ! 


N p 


7) 

Hence > 


2 

1 


1 

4 

0 


9 




0 

0 


4 o . . . 
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Z^ 1 - 2 > 0 » 


A> 


3 


16 + 0 + o - (0+0+2) 


2 1 
1 4 


8-1-7 >0 


14 0 and therefore 


function f is convex 

Assessing cnvexity-c on cavity for function of degree two is a 
simple matter regardless of number of variables. For functions of degree 
higher than two, the determinant of the matrix of second order partial 
derivatives, expanded by principal minors, may yield as many inequalities 
as there are variables. Under these conditions, specifying the domain of 
the variables for -which convexity - concavity can be assumed becomes 
rather involved. 
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apeendix 'F» 

ASSEMBLY OF A LOGARITHMIC DIODE FUNCTION GENERATOR 


Principle t 

Nse of diodes as switching elements in straight-line-segment 
function generation has Been found to be quite satisfactory. Any 


function of a monotonic nature can be generated by biased diode networks 
placed in a parallel configuration in the input network of an amplifier 



Fig.F.2* Hot of monotonic function 

The resistor values of the network can be chosen so that the biased 
diode networks ©, © & © contribute the segments A,B & C as shown in 
Fig.F.2 » 'When \ is zero, all* the three diodes are forward biased and 



conducting. Therefore the input impedance to the amplifier is the 
parallel combination of the three branch impedances, giving the slope of 


segment 1 in Fig.F.2. As the input voltage 3. is made more and more 
positive, the diodes get cut off, one at a time. Everytime a diode 
gets cut off, the equivalent input impedance of the amplifier is 
increased, thereby decreasing the slope of the generated function. Thus 
Log X function, which has a decreasing slope as the input voltage X 
increases , can be generated from such a network . 

Logarithmic function Generator [ 

The assembled LOG X Diode function generator utilizes a DC amplifie 
to produce an output voltage that is proportional to the logrithm of input 
signal vltage X. The output of this function generator is formed by seven 
straight-line voltage segments that closely approximate a logrithmic 
curve for a single polarity input voltage. Two independent logarithmic 
function generators were assembled. One generator accepts a positive 
input voltage X and produces a negative output voltage X - “5 lo S-fo 10 X * 
The second generator accepts a negative input voltage X and produces a 
positive output voltage T - 45 log l0 10X. The circuit diagram of the 
two logarithmic function generator is shown in Fig.F.3*. Terminals S & 0 
of Log X DFG are connected to terminals B & 0 respectively of a DC 
amplifier of TR-20 Analog computer. The feedback element for the 
amplifier Is a stable 5^ resistor. The remaining biased diode network 
constitutes the input impedance to the amplifier. For the positive 
input DFG, as the input voltage X is near zero, all diodes are conducting 


*TR~20 Maintenance Manual, Drawing No .0016133 03 






inlrmoc the amplifiers and check that the reference voltages of 
± 10 'volts are within specifications. 



Adj . 1 
No. ! 



Input voltage 

.> 

| Adjust 1 

1 I 

Output voltage 
7 o 


1 

+ 2.15 

E 19 

-.26 + .01 


2 

+ 5.23 

R c 

5 

-1.18 +.01 

Negative output 

5 

+ 6.92 

R 4 

“2*47 +.01 

DFG 

4 

+ 8.13 

*5 

-4.28 +.01 


5 

+ 9*05 

*2 

- 6.51 +.01 


6 

+ 9.79 

E 1 

- 9.13 + .01 


1 

- 2.15 

^22 

+.28+.01 


2 

-5*23 

R 42 

+1 «18+. 01 

Foci live output 

5 

*- 6.92 

E 41 

•42 . 47 +. 01 

DFG 

4- 

-8.13 

E 4 0 

+4 .2 8 +.01 


5- 

- 9 .O 5 

**39 

+ 6 . 5 I+.OI 



' -9.79 

^8 

+ 9 . 13 + .01 


Table F.1* Adjustment data for LoG X DFG 
3 . Starting from Adj No.1 ( 

Set the input voltage (V^) by means of pot.1 as given in 
table F.1 and observe the output voltage Fq. In case the output voltage 
is cut of tolerance, adjust the appropriate variable resistor as given 
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•under column "Adjust”. Hie adjustments must be completed in order 
from adjustment no.1 to 6 and after each adjustment, the previous 
adjustment must be checked. 

For example to adjust the positive output DFG set V ^ n to 
-2.15 volts with coefficient potentiometer 1. Adjust m©^sures 

+.28 volts. Set V^ to -5.25 volts; adjust R^ until V Q measures + 1.18 
volts. Eo chock adjustment number 1 and reset kg 2 ^ necessary. Recheck 

adjustment 2 and reset if necessary. Set adjustment 3 5 recheck adjustments 

\ 

1 & 2. The recheck procedure is necessary only for adjustments 1,2 & 3* 
Adjustments 4 >5 & 6 can be made independently. 

Results » 

The output voltage range of Log X DFG is 0 to 10 for an input 
voltage range of 0.1V to 10V. From 0.1 V to 1 V input, the output is 
within 2 c /o accuracy. Vhereas from IV to 10V input, the output is well 
within . 5 1o accuracy. In Fig. 5 *5 solid line represents the desired 

the X marks represent the actual output of the ©FO. 


LOG X curve , whereas 




